← All datasets

Metagenomics

EMG produced TPA metagenomics assembly of PRJNA728374 data set (Gut microbiome responses to dietary intervention with hypocholesterolemic vegetable oils.).

Gut microbiome sequencing from a dietary intervention study involving cholesterol-lowering vegetable oils, reassembled by MGnify. The benchmark uses InterPro functional-abundance profiles of microbial communities to predict recorded host sex.

Binary classificationLicence: PublicMGYS00006282Target: host sexmgnify ↗

Mean cross-validation scores for this dataset. Each score comes from the requested feature- and sample-cap cell, and failed fits use the constant predictor.

At this operating point

Model comparison

p=10,000, n=100 · Higher Macro-F1 is better

Random Forest is marked with a diamond. Models are ordered by the selected metric.

Across sample budgets

Learning curves

All metric values at this operating point
ModelMacro-F1MCCBalanced accuracyROC-AUC
GeneICL0.64020.30050.64550.6253
Kumo Tabular (L)0.61540.24770.62140.6079
Logistic Regression (tuned)0.61270.24090.61770.5764
TabFM0.60570.240.61380.6238
Logistic Regression0.60030.21740.60630.5889
TabPFN 3.50.59820.21780.60520.6073
RealTabPFN 2.50.59720.21630.60580.5914
Seldon0.5950.21950.60580.6026
AutoGluon0.58910.22390.6040.5782
Seldon-Mini0.58820.19450.59430.614
TabDPT †0.57710.16930.58290.5851
Kumo Tabular (M)0.57240.16980.58180.5892
MLP (tuned)0.56540.14020.56880.5713
Causilo0.55720.1390.56480.5775
TabPFN Wide 5k (ne3) ‡0.55430.150.56630.6001
FTFM-1 † ‡0.55170.120.55920.5774
RealMLP0.53930.16510.57150.6224
MLP0.53880.089750.54370.5527
Extra Trees0.53370.081990.53890.5358
MITRA0.53340.084740.54110.5286
RealTabPFN v20.53090.078760.53880.5429
TabM0.52450.066970.53220.5315
XGBoost0.51430.038660.51830.5151
Extra Trees (tuned)0.50860.033660.51550.5022
XGBoost (tuned)0.50720.032640.51620.5135
Random Forest0.5040.037020.51630.521
Random Forest (tuned)0.48920.0044440.50060.5229
LimiX20.4149-0.1630.42120.4004